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ANALYSIS  OF  A  PHASE -LOCKED  LOOP 
AND  A  GENERAL  FEEDBACK  SYSTEM  WITH  A  LIMITER 


H.  J.  Kushner 
Y.  Ear-Ness 

1.  Introduction 

Consider  a  (linear  or  nonlinear)  dynamical  system  with  wide¬ 
band  noise  input.  In  communication  theory,  it  is  often  of  con¬ 
siderable  interest  to  approximate  such  systems  by  diffusion  models 
so  that,  e.g.,  Fokker-Planck  and  other  "diffusion"  process  tech¬ 
niques  can  be  used.  In  [11,  a  general  and  powerful  method  for 
doing  this  was  developed.  Roughly,  the  input  noise  process  is 
parametrized  by  e  and  as  e  -*•  0,  the  bandwidth  (BW)  goes  to 
infinity,  while  the  power  per  unit  BW  approaches  a  constant.  The 
process  which  corresponds  to  the  limit  of  the  sequence  of  measures 
of  the  output  or  system  state  processes  {xe(-)}  is  found  by  tech¬ 
niques  of  weak  convergence  theory . 

The  method  is  particularly  useful  when  the  noise  (and/or 
signal)  is  processed  nonlinearly.  In  order  to  illustrate  the 
method,  three  applications  were  developed  in  [1] :  (a)  a  phase 
locked  loop  (PLL) ;  (b)  an  adaptive  antenna  array;  and  (c)  output 
of  a  hard  limiter  followed  by  a  filter.  Difficulties  with  some 
of  the  heuristic  methods  were  avoided.  In  fact,  many  of  the  more 
heuristic  arguments  for  problems  (a) ,  (b)  use  (implicitly  or 
explicitly)  a  "wide  band  assumption" . 

In  this  paper  a  very  interesting  and  more  difficult  new 
application,  essentially  a  combination  of  (a) ,  (c)  above,  is 
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discussed.  There  is  a  well-developed  classical  theory  of  PLLs 
[2],  [3].  Recently,  a  strong  practical  interest  in  PLLs  that  use 
either  nonlinear  filters  or  static  nonlinearities  has  developed 
[4],  [5]  and  there  have  also  been  prior  indications  (based  on 
simulation  studies)  that  use  of  certain  nonlinearities  could 
actually  improve  the  loop's  performance.  The  improvements  in 
performance  that  are  possible  with  the  use  of  a  hard  limiter  type 
nonlinearity  will  be  demonstrated  theoretically,  via  the  method 
of  [1],  and  confirmed  by  simulation.  It  seems  to  the  authors 
that  there  are  no  current  alternative  methods  for  the  treatment 
of  such  problems  in  a  rigorous  or  readily  rigor i zatle  but  intuitive¬ 
ly  convincing  manner.  A  number  of  interesting  ideas  and  results 
appear  in  [5],  but  the  method  requires  an  "equivalent  white 
noise"  input,  and  would  seem  to  have  great  difficulty  (even  with 
a  heuristic  treatment)  with  the  problem  treated  here.  However, 
the  general  conclusions  of  {5]  are  consistent  with  our  own. 

Our  development  will  be  rigorous  in  part  and  heuristic  in 
part.  It  is  partly  heuristic  because  we  seek  to  simplify  the 
analysis  to  avoid  some  of  the  more  onerous  calculations.  But 
even  there,  the  development  will  be  guided  by  the  intuition 
developed  in  (1]  for  the  properties  of  the  simpler  systems 
treated  there.  The  point  is  that,  used  even  heuristically , 
the  method  provides  an  interesting  and  powerful  tool  for  getting 
the  appropriate  diffusion  approximations  to  many  nonlinear 
systems  whose  (even  formal)  treatment  would  be  much  more  dif¬ 
ficult  by  alternative  methods. 
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Abstract 

A  phase-locked  loop  (PLL)  with  a  hard  limiter  and  wide-band 
noise  input  is  analyzed.  A  powerful  method  introduced  in  [1]  for 
obtaining  a  close  diffusion  approximation  to  a  system  with  a  wide¬ 
band  input  is  applied.  For  small  input  noise  power  per  unit  band¬ 
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properties  over  the  classical  PLL.  This  is  demonstrated  theoret¬ 
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The  results  and  method  are  also  quite  important  in  control 
theory.  There  the  filter  and  VCO  would  or  could  be  replaced  by 
general  linear  or  nonlinear  dynamical  systems  and  the  multiplier 
by  an  adder.  In  fact,  for  this  case,  our  results  are  rigorous,  and 
indicate  the  important  role  which  a  hard  limiter  can  play  in  improv¬ 
ing  a  systems  noise  immunity  when  the  noise  is  small  but  the  bandwidth 
is  large. 

We  are  concerned  with  the  systems  of  Figures  1  and  2,  the 
first  (resp.,  second)  being  a  first-  (arbitrary,  resp.)  order 
PLL.  By  suitable  choice  of  D,  E,  C,  G  in  Figure  2,  any  zonal 
filter  can  be  well  approximated.  In  Figures  la,  2a  we  have  a 
hard  limiter,  and  in  Figures  lb,  2b  an  approximation  to  a  hard 
limiter.  ne(.)  denotes  the  input  noise,  ae(-)  the  estimate  of 
the  "signal"  phase  0(-)  of  the  input  signal  A  sin  (u>ot+0  (t)  )  .  The 
general  type  of  approximation  gQ  ( * )  which  is  used  for  g(*),  the  hard 

limiter,  is  graphed  in  Figure  lc.  The  treatment  of  the  general 
case  of  Figure  2  is  almost  identical  to  that  of  the  simpler 
case  of  Figure  1;  one  only  carries  a  few  extra  terms  (which  are 
not  hard  to  handle  in  the  development) .  In  the  interest  of 
simplicity,  derivations  for  the  first-order  case  will  be  given; 
the  results  for  the  general  case  will  be  only  stated.  The 
results  indicate  some  rather  surprising  and  important  advantages 
of  the  use  of  the  limiter;  for  small  noise  power,  the  acquisition 
range  and  tracking  ability  are  increased,  and  acquisition  time 
decreased,  as  compared  with  the  case  with  no  limiter.  These 


1 
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la.  PLL  with  hard  limiter 


FIG.  1,  FIRST  ORDER  PLL 
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advantages  are  borne  out  by  simulations,  and  have  important 
analogues  in  the  automatic  control  problem  also. 

In  Section  2  various  assumptions  are  given  and  in  Section  3 
a  result  of  [1]  is  applied  directly  to  get  a  limit  approximation 
in  a  heuristic  manner.  The  limit  seems  to  capture  the  essential 
properties,  and  it  is  compared  with  the  comparable  equation  for 
the  classical  first-order  PLL.  Section  4  discusses  some  simula¬ 
tion  results.  The  Appendix  contains  various  parts  of  the  detailed 
development. 

Note  that  it  makes  no  mathematical  or  physical  sense  for 
ne(>)  to  be  a  white  Gaussian  noise.  Owing  to  the  properties  of 
white  Gaussian  noise,  the  output  of  the  limiter  would  be  zero. 

So  we  must  deal  with  a  wide  band  input. 


2.  Assumptions 

The  noise  model.  For  the  sake  of  concreteness  in  the  cal¬ 
culation  and  in  order  to  be  able  to  use  the  results  of  [1], 

Section  6,  it  is  supposed  that  nG  (t)  =  ye(t)/e  where  ye(t)  = 

2 

y(t/e  )  and  y(-)  is  a  stationary  Gaussian  process  with  correlation’ 
2 

function  0  exp  -  a|x|,  a  >  0.  Reasons  for  this  scaling  are  dis¬ 
cussed  in  [1],  Section  2  and  in  [6].  It  is  a  convenient  and 
common  way  of  getting  a  noise  process  r  e  ( • )  whose  spectrum 

converges  (as  c  -*■  0)  to  that  of  a  white  noise  with  a  constant 

2 

power  per  unit  bandwidth,  namely  2o  /a.  It  is,  perhaps,  the 
simplest  model  that  could  be  used  for  our  wide  band  approxima- 


G 

tion  technique.  In  order  for  n  (•)  -*■  "white  Gaussian  noise"  or 

/ne(s)ds  Wiener  process  as  e  -*■  0,  a  contraction  of  the  time 
0 

scale  and  an  increase  in  the  amplitude  of  y ( • )  is  required  (as 
e  -*■  0)  .  This  is  discussed  further  in  the  reference.  The  partic¬ 
ular  form  of  y(*)  was  chosen  partly  for  convenience,  in  that  it 
enables  us  to  use  an  available  result.  Any  Gaussian  process 
whose  correlation  function  decreases  exponentially  can  be  used, 
but  the  V2  In  2/a  coefficient  in  (3.1)  and  in  derivative  expres¬ 
sions  would  be  replaced  by  a  different  coefficient  although  the 
general  result  of  the  sequel  (the  improved  tracking  ability  for 
small  power  per  unit  BW  with  the  use  of  the  limiter)  would  remain 
true . 

In  the  classical  case  (e.g.,  [2,  3]),  a  somewhat  similar  "limit" 

assumption  is  made;  although  the  noise  nG ( • )  is  not  explicitly 
parametrized,  and  no  limits  are  explicitly  taken,  in  the  various 
approximations  which  are  made  it  is  implicitly  or  explicitly  assumed 
that  the  BW  is  "very  wide"  (this  assumption  is  used  in  an  intuitive 
or  formal  way  only,  in  the  classical  case) .  For  the  system  without 
the  limiter,  much  weaker  assumptions  on  n  (•)  can  be  used  [1]  without 
over-complicating  the  development. 

The  scaling  Le .  If  L  =  L,  a  number  not  depending  on  e, 
then  a  heuristic  "averaging"  type  of  analysis  implies  that  the 
"effective  gain"  of  either  the  L£g(')  or  Lega(*)  nonlinearities 
goes  to  zero  as  e  +  0  (or,  equivalently,  as  BW  -*■<*>).  Thus  in 
any  "limit"  analysis,  L£  must  increase  as  e  decreases.  In  any 
particular  practical  system,  operating  in  a  fixed  signal  and  noise 
environment,  one  particular  value  of  L  =  L£  will  of  course  be  used. 
Other  things  remaining  equal,  as  the  BW  of  the  input  process  in¬ 
creases  (without  the  power  per  unit  BW  degenerating  to  zero,  in 
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the  "pass  band") ,  this  value  of  L  will  have  to  increase.  How  this 
value  is  to  be  chosen  in  any  particular  application  is  not  impor¬ 
tant  here.  What  is  important  is  that  eL£  must  converge  to  a 
constant  L  >  0  as  e  -*■  0.  (See  Appendix.)  This  property  holds 
if  y(<)  is  any  stationary  Gaussian  process.  So  =  L/e  will 
be  used  in  the  limit  analysis.  If  cLe  -*■  0  as  e  -*■  0 ,  the  limit 
system  will  be  an  open  circuit. 

3.  A  Heuristic  Analysis 

Consider  the  system  of  Figure  la.  In  [1],  Section  6,  the 
limit  equation  (as  c  -*  0)  for  the  output  process  xe  ( • )  of  a  hard 
limiter  of  level  L  with  input  s(t)+n£(t)  (s(-)  being  piecewise 

continuous,  but  arbitrary  otherwise  -  it  is  an  input  signal)  is, 
derived.  The  limit  process  has  the  same  distribution  as  the  diffusion 

(3.1)  dx  =  L/277  dt  +  L/2  In  2/a  dB, 

where  B(-)  is  (and  always  will  be  in  this  paper)  a  standard 
Wiener  process.  The  following  heuristic  derivation,  for  which 
greater  justification  is  provided  in  the  Appendix,  captures  the 
essential  effects. 

At  point  (a)  of  Figure  la,  the  signal  is 

(3.2)  KA  sin(mot+0  (t))cos  (w0t+9e  (t)  )  +  K  cos  (co0t+6e  ( t)  )  n£  ( t) 

=  ae (t)  . 

Interpret  v/|v|  =  0  if  v  =  0  (let  sign  0=0  for  definiteness). 


-9- 


At  (b)  in  Figure  la,  we  have 

(*)  ze(t)  =  6e(t)  =  |  sign  [ae  (t) /|cos  (u)0t+6e  (t) )  |  ]  . 

Supposing  that  the  9e(*)  variations  are  "slow"  compared  with  those 
of  n£(*),  drop  the  0E(-)  terms  in  the  noise  coefficient 
ne  ( t)  cos  (u)gt+6e(t))/|  cos  (ui^t+e  (t)  )  |  of  the  argument  of  the  function 
on  the  right  side  of  (*)  .  This  is  the  main  simplifying  assumption 
and  will  be  discussed  further  below.  There  is  no  need  for  this  step 
if  the  multiplier  in  Figures  1  or  2  is  replaced  by  an  adder  (what¬ 
ever  replaces  the  VCO)  as  in  the  control  problem.  The  noise  term 

in  the  argument  of  the  function  on  the  right  side  of  (*)  is  now 
£  O 

sign(cos  u)Qt)n  (t)  .  On  substituting  t/e  -*•  t,  this  becomes 
2 

sign(cos  u)Qe  t)-y(t)/e.  For  small  e  and  over  a  finite  interval, 

the  statistics  of  this  process  are  essentially  those  of  y (■)/£. 

As  will  be  seen  in  the  Appendix,  it  is  the  statistics  in  the  new 

scale  which  determine  the  correct  limit.  Thus,  since  we  are  con- 

2 

cerned  with  small  e,  this  suggests  that  the  sign (cos  t)  term 
can  be  replaced  by  unity  without  altering  the  limit.  Finally, 
making  these  substitutions  we  have  the  formal  approximation: 

sign(ae(t))  %  sign  [A  sin  (u>gt+e  (t)  )  sign  (cos  (a)Qt+ee  (t)  )  +  ye(t)/e] 

=  sign[se(t)  +  ye(t)/e], 

where  se(»)  is  defined  in  the  obvious  way.  With  this  approxima¬ 
tion  at  point  (b)  in  Figure  la,  we  have 
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(**)  2e(t)  =  0c(t)  =  \  sign [se ( t)  +  yC(t)/e). 

Next,  ignoring  the  fact  that  se  ( • )  depends  on  8e(*),  and  formally 
using  the  limit  result  (3.1),  yields  that  the  limit  (as  e  -*•  0)  of 
(8e(*)}  has  the  same  distributions  as  the  process  §(•)  given  by 
(we  replace  the  0 e  ( - )  inside  the  sign  by  the  "limit"  §(•)  also) 

A  sin  (o)nt+6  (t)  )  sign  (cos  (u»nt+0  (t)  )  ] 

(3.3)  d0  (t'  =  L/27*  - - - - - dt 

a 

+  2-  dB. 

Greater  justification  for  the  limit  representation  (3.3)  will  be 
given  in  the  Appendix.  Equation  (3.3)  has  a  unique  solution  (in 
the  sense  of  measure) ,  despite  the  discontinuity  [8] .  Also,  the 
argument  concerning  setting  the  sign  cosfaigt)  term  equal  to  unity  can 
be  justified  in  the  sense  that  it  does  not  affect  the  limits.  The 
limit  (3.3)  can  be  justified  if  we  start  with  (**)  ,  use  the  approx- 

4* 

imation  g^  ( • )  instead  of  g(*),  and  then  let  a  -*•  0  as  e  -*■  0.  See 
the  Appendix.  The  main  difficulty  lies  in  ignoring  the  0  depen¬ 
dence  of  the  coefficients  of  ne(t).  This  dependence  gives  rise  to 
what  is  usually  called  the  "correction  term",  an  additional  drift 
term  which  should  appear  in  (3.3).  Purely  formal  calculations  sug¬ 
gest  that  this  term  "oscillates  with  u>g",  and  that  it  would  average 
out  if  either  Wq  is  large  or  a  narrow  band  filter  is  used,  as  in 
Figure  2.  This  is,  of  course,  what  happens  to  the  correction  term 

T - ; - ;  ;  ■ 

The  reason  for  the  use  of  the  approximate  hard  limiter  9a(")  in 

the  analysis  in  the  Appendix  is  that  our  approach  requires  a  differ¬ 
entiable  nonlinearity.  In  the  Appendix,  we  get  the  limit  when  e  -*■ 

0  and  a  -*■  0  as  e  -*•  0.  This  is  a  reasonable  point  of  view. 
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11. 


in  the  standard  case  (1,  Section  4],  but  here  we  are  not  yet  able 
to  explicitly  evaluate  this  term. 

3.1  Approximation  of  (3.3).  Let  us  now  approximate  (3.3)  by 
a  simpler  system.  The  justification  of  the  approximation  (for 
large  o)q)  appears  in  the  Appendix.  First  expand  q(a)  =  sign  (cos  u) 

2  71 

£k_^  qk  cos  ku  over  [  — tt  ,  tt  ]  ,  where  <3k  *  —  /  f  (u)  cos  ku  du  = 
(4/irk)sin  krr/2.  Thus  q2k  =  0,  all  k,  and 


sign  (cos  ((jjQt+8)  )  = 


?  I  i®ir  ”s(2k*i)  (»0t+«) 

K— U 


4x1.  . 


sin(aj0t+e)q(oj0t+e)  =  (-)  sin  (0-0)  +sin  (2wQt+0+0)  ) 


(  1  ]  " 

1  sin(a,0t+e) 


cos(2k+l)  (a)ot+0) 


=  ^(sin(0-0))  +  F(<o0,t,e,e) . 


Now,  we  can  take  either  of  two  approaches.  The  simplest  is 
simply  to  assert  that  F,  which  contains  the  "high-frequency"  terms, 
will  be  filtered  out.  An  alternative,  which  is  developed  in  the 
Appendix,  is  to  use  the  averaging  method  of  (1)  (see  Section  4 
there)  again,  but  where  the  0(0  of  (3.3)  is  now  parametrized 


by  Wq  and  to  show  that,  as 


»,  the  8(0  converge  weakly 


(in  CfO,«);  see  Appendix)  to  the  solution  of  the  "averaged 
equation" 


Equation  (3.4)  is  the  desired  limit  equation.  Suppose,  for 
purposes  of  representation,  that  e(*)  is  differentiable.  Then, 
with  <j>  =  e-e. 


(3.5)  d4>  =  0dt  -  L(-)3/2  dt  -  LJ^  In  1  dB. 

77  a  *  a 

See  Appendix  3  for  the  details. 

The  general  filter  case.  The  case  of  Figure  2  can  be 
dealt  with  similarly,  to  obtain 

(3.6)  d<|>  =  0dt  -  Cvdt  -  LG [~( J) 3/2sin  <p  dt  +  J2 . -~-2  dB  ]  , 

U  TT  "cl 

dv  =  Dvdt  +  LE(|(|)3/2  sin  $dt  +  ~  dB]  . 

3.2  Limit  equations  for  the  classical  case  (no  limiter).  For 
comparison  purposes,  only  the  first-order  case  will  be  studied. 

The  classical  derivation  appears  in  [2],  [3],  A  derivation  of  the 
limit  as  input  BW  -*■  00  (an  assumption  also  made  for  the  classical 
derivation)  is  in  [1],  Section  4.  In  that  reference,  nG(*)  was  a 
more  general  process  than  used  here.  Specializing  to  the  nE(>) 
used  here,  we  have  [1,  eqn.  (4.3)]:  For  fixed  u)q  ,  e  ( - )  = 

0 ( • ) - 0e ( - )  converges  weakly  (in  C[0,»))  to  the  solution  of  the 


diffusion  equation 


(3.7)  d<Mt)  =  0(t)dt  -  7j— -[sin  4>  ( t )  +  sin  ( 9  ( t)  +0  ( t)  +2mct)  ]  at 

2  2 

+  0  —  -  cos  (a)nt+0  (t)  )  sin (w, t+6 ( t) ) dt 

3  U  0 

-  K/|acosU0t+e(t))dB  . 

As  tog  00 ,  <)>(•)  (parametrized  by  converges  weakly  (in 
C[0,°°);  see  [1])  to  the  solution  of 

(3.8)  d<{>  =  0dt  -  ^  sin  $  dt  -  K  —  dB. 

2  /£ 

The  third  term  on  the  right  of  (3.7),  the  so-called  "correc¬ 
tion"  term,  arises  due  to  the  non-independence  of  n£ (t)  and  0e(t). 

The  classical  derivation  ignores  this  dependence.  But,  as  -*•  °°, 
the  term  is  "averaged  out",  whether  or  not  a  filter  is  used  in  the 

PLL.  In  fact,  by  our  neglect  of  the  0e  dependence  of  the  coef- 

•  #  £ 

ficient  of  n  (•)  in  the  argument  leading  to  (3.3),  the  correction 
term  does  not  appear. 


3.3  Comparison  of  (3.5)  and  (3.8).  L  in  (3.5)  plays  the 
role  of  K  in  (3.8).  The  salient  and  surprising  difference 
concerns  the  role  of  a.  In  (3.8),  it  affects  the  noise  term 
(proportionally).  In  (3.5),  it  affects  the  drift  term  (inversely) 
It  is  thus  expected  that  for  small  a,  the  limiter  would  improve 
the  acquisition  and  tracking  properties  of  the  PLL. 
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Let  9  =  oj  ,  a  constant,  and  linearize  the  sin  in  both  (3.5) 

and  (3.8)  about  4  =  0.  Then  the  asymptotic  (linearized)  mean 

~  2 

square  values  E(0-0)  are 


(3.9)  (limiter  (3.5))  u)2(£)3 

LA 


+  L  (In  2) (J)3/2  ~ 


Jo2 

'  3.87  ‘  *  1.36  g  , 


4u> 


(3.10)  (no  limiter  (3.8)) 


2  2 
K  A 


1  +  Ko 


LA* 

2 


Aa 


The  major  shortcoming  of  the  first-order  system  with  no  limiter  is 
its  poor  acquisition  ability,  irrespective  of  a ,  a  shortcoming 
which  the  use  of  the  limiter  overcomes  when  a  is  small,  and  the 
bandwidth  large.  The  same  relative  advantage  holds  for  the  general 
case  of  Figure  2,  as  we  can  easily  see  from  (3.6). 


3.4  An  alternative  heuristic  development.  In  order  to  gain 
some  intuitive  feeling  for  the  effects  of  different  approximations 
of  the  input  to  the  limiter,  let  us  now  suppose  that  the  input 
(3.2)  to  the  limiter  is  replaced  by  the  "natural  approximation" 
(not  always  so  natural  in  the  nonlinear  case) 

(3.11)  P-  sin  (6 (t) -0e (t) )  +—  ne(t), 

2  /2 

where  we  get  the  /2  by  "averaging"  the  square  of  the  coefficient 
of  ne(*)  and  then  taking  its  square  root,  while  ignoring  the  coef¬ 
ficient's  6e  dependence.  Then,  by  using  the  argument  which  led  to 


(3.3),  we  get  the  limit  equation 
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(3.12) 


d<J>  =  Odt  -  AL  ■  dt  -  L 

/it  a 


A 


In  2 


d3 . 


The  ratio  of  the  drift  coefficient  in  (3.5)  to  that  in  (3.12)  is 
2/2/tt  =  0.9.  Thus,  the  process  (3.12)  would  be  expected  to  have 
smaller  errors  -  but  not  by  much  -  and,  otherwise,  the  same 
qualitative  properties  as  (3.5)  has. 


3.5  An  automatic  control  problem.  The  results  are  directly 

applicable  to  the  typical  feedback  situation  of  Figure  3.  s(*) 

£ 

is  the  signal  or  informational  component  in  the  input,  r.  (•)  is, 
again ,  the  wide-band  noise  of  Section  2  and  F ( • )  and  G ( • )  are 
smooth  functions  with  at  most  a  linear  growth  rate.  The  same 
formal  argument  which  led  to  (3.3)  yields  (no  dropping  of  the 

0e ( • )  in  the  noise  coefficient  is  required,  as  was  done  in  the  PLL 
case  in  order  to  get  (**)  there)  that  (ve(*)}  converges  weakly  to 
the  solution  of 


(3.13)  dv  =  F  (v)  dt  +  LDp— -----  dt  +  y/2-  *n  2  dfij. 

The  l/o  effect  in  (3.13)  would  seem  to  be  a  rather  impor¬ 
tant  result.  The  result  is  not  entirely  expected  and  undoubtedly 
has  many  useful  applications  to  control  problems  when  the  noise 
is  small  in  power  per  unit  BW,  but  of  wide  BW.  For  this  problem, 
the  method  in  the  Appendix  rigorously  justifies  (3.13). 
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4.  Simulation  Results 

The  main  purposes  of  the  (digital)  simulations  were  to  verify 
the  effects  of  the  1/a  in  the  drift  term  of  the  limit  equation 
for  the  "hard  limiter"  case,  and  to  get  some  rough  idea  of  the 
"rate"  of  convergence  to  the  limit,  as  well  as  a  rough  comparison 
with  the  case  of  no  limiter.  Consistent  with  these  goals,  and 
in  order  to  avoid  (time-scale  and  length  of  simulation)  problems 
in  simulating  either  (3.3)  or  the  original  system  with  the  u>q 
present,  we  simulated  the  simpler  cases  of  Section  3.4,  where 
(3.11)  appears  at  the  limiter  input.  Typical  samples  of  the  results 
appear  in  Tables  1  and  2.  The  quantities  are  sample  means  and 
variances  over  a  300  time  unit  interval. 

Discussion.  From  Table  1,  it  can  be  seen  that  the  limit 
equation  results  are  very  close  to  those  of  the  actual  systems. 

The  results  are  closer  for  the  no-limiter  case,  and  for  the  larger 
value  of  o.  The  presence  of  the  limiter  nonlinearity  seems  to 
slow  down  the  convergence.  (Of  course,  even  without  the  limiter, 
the  system  is  nonlinear,  but  "more  softly  so'-.)  The  quality  of 
the  tracking  ability  is  demonstrated  by  Table  2.  For  e  5.  • 

the  actual  system  performs  quite  close  to  the  limit  system.  It 
is  remarkable  that  even  for  larger  values  of  e,  the  performance 
with  the  limiter  can  be  more  favorable  (than  that  without  the 
limiter)  than  suggested  by  merely  comparing  the  true  limits. 

The  relative  contributions  of  the  means  and  variances  are 


(qualitatively)  exactly  as  expected.  The  decrease  in  mean  square 
error  as  a  decreases,  as  suggested  by  the  1/a  factor  in  (3.5), 
is  clearly  demonstrated  by  Table  2.  As  noted  above,  the  useful 
effect  of  the  limiter  (as  quantified  by  the  1/a  factor  in  the 
limit  equation)  is  very  clear,  even  for  e  =  1.  Owing  to  the  fact 
that  the  maximum  slope  of  sin  u  is  at  u  =  0,  the  actual  data  are 
all  smaller  than  those  predicted  by  (3.1)  (and  the  appropriate 
analogue  of  (3.8)  for  the  system  (3.12)). 

The  linearizations  (3.10)  and  the  analogue  of  (3.9)  for  the 
system  (3.12)  give  conservative  estimates  of  the  numbers  in  the 
tables.  This  is  because  the  linearization  results  are  obtained 
by  replacing  sin  <J>  by  <j>  in  the  dynamics,  a  "stabilizing"  change. 
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No  limiter 

sample 
mean 

limit  . 11 

e  =  1  .11 

e  =  1/2  -.04 


sample 

variance 

o  =  .5 

.30 

.20 

.27 


Limiter 

sample  sample 

mean  variance 

.06  1.0 

.02  .38 

.02  .82 


a  =  .25 


limit 

.05 

.068 

i 

• 

o 

■vj 

.40 

e  *  1 

.05 

.046 

.05 

.12 

e  =  1/2 

-0.2 

.062 

-.02 

.23 

Table  1.  First-order  loop,  0(t) 


0q,  a  constant 


limit 
e  =  1 
e  =  1/2 


limit 
e  »  1 
e  *  1/2 
e  *  1/4 


I' 

L 


-20- 


No  limiter  Limiter 

o  =  1/2 


sample 

mean 

sample 

variance 

sample 
mean  square 
error 

sample 

mean 

sample 

variance 

sample 
mean  square 
error 

.59 

.46 

.81 

.26 

.95 

1.02 

.62 

.24 

.62 

.15 

.47 

.49 

.58 

.58 

.84 

.23 

.91 

.96 

o  = 

1/4 

.55 

.060 

.37 

.14 

.34 

.36 

.54 

.045 

.33 

.086 

.10 

.10 

.57 

.07 

.40 

.12 

.26 

.27 

.14 

.29 

.31 

Table  2.  First-order  loop,  0 (t)  =  0(0)  +  t/4. 


Appendix  1:  Simplifying  the  Problem 


Modifying  the  problem.  The  given  problem  will  be  modified 
in  several  ways,  some  insignificant,  and  Theorem  1  of  [1]  applied 
to  illustrate  the  type  of  argument  required  to  justify  the  limit 
equations.  First,  owing  to  mathematical  necessity,  we  must  work 
with  a  smooth  but  arbitrarily' close  approximation  to  the  hard  limiter 
I.e.,  the  system  of  Figure  1  will  be  used.  The  object  is  to  show 
that  the  diffusion  approximation  is  arbitrarily  close  if  e  is 
small  and  gQ  is  close  enough  to  a  hard  limiter.  When  we  discuss 
limits  as  e  -+■  0  and  a  -*■  0  (i.e.,  as  BW  +  “  and  ga(*)  hard  limiter), 
we  mean  that  e  -*■  0,  a  -*■  0  simultaneously  with  e  -+•  0  "sufficiently" 
faster";  in  particular  that  /e/a  -*•  0  as  e  -+■  0.  This  particular 
ratio  is  due  to  the  method  used  and  is  probably  not  generic  in  any 
sense.  ga(-)  is  required  to  have  a  continuous  first  derivative, 
which  is  bounded  by  C/a  in  [-a, a]  (the  derivative  is  zero  out  of 
this  interval) ,  where  C  always  denotes  a  constant,  the  value  of 
which  may  change  from  usage  to  usage. 

Let  y0(-)  denote  a  stationary  Gaussian  process.-  independent 

2  e  2 

of  y(*)»  and  with  covariance  Ogexp  -at.  Define  yQ(t)  =  yQ(t/e  ) 

and  n^(t)  ®  yg(t)/e.  In  order  to  "smoothe"  the  sign(ccs)  in 
(3.3),  we  add  Kn^ ( * )  to  the  signal  at  the  input  to  the  nonlinear¬ 
ity.  The  process  Kng(*)  converges  to  a  white  Gaussian  noise  with 

2  2 

spectral  density  K  cjg/a  as  e  -*■  0  and  (as  will  be  seen)  has  neglig- 

2 

ible  effect  on  the  result  when  aQ  is  small.  So  the  modification 
is  harmless  and  is  mainly  for  mathematical  convenience. 

With  this  addition,  the  input  to  the  nonlinearity  ga ( * )  is 
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(Al)  ag(t)  E  KA  sin(o)0t+6(t)  )cos(o)0t+ee  (t)  ) 

+  K  (cos  (u)Qt+0e  (t)  )  ne  (t)  +KHq  (t)  . 

Two  additional  alterations  will  be  made,  the  first  one  harm¬ 
less  and  merely  for  convenience  in  the  analysis,  the  other  more 

,  p  2  2  2  *  f  —1  /9 

important.  Define  8  (t)  =  [oQ  +  a  cos  (wQt+0  (t) )  ]  '  /K  and  write 

(A2)  e£(t)  =  |  ga(e£(t)a£(t)  ]  +|<sga(t), 

where 

figa(t>  =  ga(ao<t))-ga(ee(t)ao(t)) • 

Owing  to  the  positiveness  of  8e  C  * )  ,  6gQ(t)  ^  0  only  vrhen  the  argu¬ 
ment  of  9a(*)  is  less  than  some  Cot  in  absolute  value.  The  proper¬ 
ties  of  y ( - )  and  ( • )  imply  that  there  is  a  real  C  such  that 
E|  6ga(t)  |  Cae.  Partly  due  to  this,  the  deletion  of  the  6ga(*) 
in  (A2)  does  not  affect  the  limit,  and  we  drop  the  term  from  (A2) . 

We  now  have  the  system  0e  =  Lga ( 3e (t) a^ (t) ) /e .  For  the 
final  alteration,  note  first  that  the  noise  term  in  the  argument 

of  ga<-)  above  is  i[OQ+a2cos  (u>gt+0e  (t) )  ]  1//2  [cos  (u)Qt+0e  ( t) )  ye  ( t) 

e  2 

+y0(t)  ]  .  Change  time  scale  t/e  -*■  t.  As  will  be  seen,  the 

calculations  which  concern  the  shape  of  the  limit  are  in  the  new 

time  scale.  In  this  scale,  the  noise  term  is 

i[OQ+a2cos(u)0e2t+§G(e2t)  )  ]  ~1/2  [cos  (u>0e2  t+0e  (e2t) )  y  (t) +y0  (t)  ]  . 
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If  6e(*)  does  not  become  “too  wild  -  too  fast"  as  e  ■*  0.  then 

for  small  e  the  term  has  essentially  the  properties  of  a  station- 

*v  -at 

arv  Gaussian  process  v(*)  with  mean  0  and  covariance  e  and 

we  replace  it  by  such  a  process.  Such  a  facile  argument  does  not 

justify  the  replacement  (for  the  PLL  case) . 

2 

Dropping  the  ui^e  t  part  is  unimportant  and  does  not  affect 
the  result.  Dropping  the  0e  dependence  is  important,  because  it 
eliminates  the  correction  term.  Even  without  this  alteration, 

{ 0 G  ( * )  >  can  be  shown  to  be  tight*  in  D[0,»),  but  the  details  are 
quite  lengthy  and  will  not  be  given.  The  main  problem  (apart 
from  the  length  of  the  calculation)  is  that  we  have  not  been  able 
to  get  a  nice  expression  for  the  correction  term.  However,  some 
formal  and  rough  calculations  suggest  that  its  deletion  does  not 
substantially  alter  the  system's  main  qualitative  properties,  and 
that  the  effects  of  the  deleted  term  are  small  for  large  u>Q. 

In  the  control  theory  problem  of  Figure  3  where  the  multiplier 
is  replaced  by  an  adder,  the  input  noise  is  not  multiplied  by  a 
state-dependent  function  at  the  input,  the  actual  value  of  the 
input  to  the  nonlinearity  can  be  used  in  lieu  of  (Al)  and  there  is 
no  need  to  drop  any  terms.  Our  method  is  then  rigorous. 

Finally,  the  system  to  be  analyzed  is 


(A3)  0e(t)  =  |  ga(s(t,0e(t))  +ye(t)/e>, 


*The  terminology  is  that  of  weak  convergence  theory"! Billingsley" 
hlid  n2F!f  a  he  Sp?Ce  of  real-valued  functions  which  have  lefl 
toSoloav * right  continuous,  and  which  has  an  appropriate 
.  ?  •  y  tightness,  we  mean  that  the  measures  that  {Pe(*)} 

^o“??3anS  c,0-Z\  “Jh  Weak*  ^uentially  compact.  Latar  wi  ise 

(on  To  ??  or  °f  real-valued  continuous  functions 

von  iu,tj  or  [0,®))  with  the  sup  norm  topology. 
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where  y  e(t)  =  y(t/e2)  and  s(t,0e(t))  =  ABe  (t)  sin(u>0t+8  (t) ) 
cos  (u>Qt+0e  (t) )  . 


Appendix  2 

Derivation  of  the  limit  (as  e  -*■  0,  a  -*•  0)  of  the  processes 
{ 0 e  ( • ) }  of  (A3).  Theorem  1  of  [1]  will  be  applied  and  most  of 
the  details  of  the  following  proposition  will  be  given: 

{0e  ( • )  ,  e-*-0 ,  a-*-0  }  is  tight  and  as  a  -*•  0  and  e  -*■  0,  8e(*)  converges 

+  /\  ,  # 

weakly  to  the  process  0(*)  satisfying  the  diffusion  equation 
(we  set  L  =  1  for  simplicity;  the  limit  is  linear  in  L) 


(A4) 


d0(t) 


-S 


S  (t ,  8  (t)  ) 


tit  + 


/ 


2  In  2 


dB, 


where 


s(t,0)  =  [a2+o2cos  ((Ogt+0)  ]  1//2  [A  sin  (a)Qt+0  (t) )  cos  (toot+0)  ]  . 


Then,  in  Appendix  3,  it  will  be  shown  that  as  oQ  0,  the  solu¬ 
tion  of  (A4)  converges  weakly  to  that  of  (3.3)  and  as 

the  solution  of  (3.3)  converges  weakly  to  that  of  (3.5). 

In  D [0,«°)  .  Even  though  the  paths  are  all  continuous,  it  is  con- 
venient  and  traditional  in  the  proofs  of  the  basic  theorems  to  as¬ 
sume  that  they  are  elements  of  a  space  of  discontinuous  functions 
D[0,<»).  The  reason  is  that  the  weak*  sequential  compactness  of 
the  associated  measures  is  easier  to  prove  there.  This  is  purely 
for  mathematical  convenience  and  need  not  trouble  us.  Of  course, 
the  measures  are  concentrated  on  any  measurable  set  in  D[0,«>) 
which  contains  the  continuous  functions. 
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The  method.  The  technique  is  close  to  that  of  [1,  Section 

6],  the  main  difference  being  due  to  the  fact  that  our  9a(*)  is 

not  a  limiter  and  that  s(t,0£)  has  §e  dependence.  We  briefly  recall 

the  definitions  (from  [1])  of  A£  and  p-lim.  Let  denote 

expectation  conditioned  on  {y  (u) ,  u<t)  *  {y(u),  u<t/e  } .  Let 

f£(*)  be  (progressively  measurable)  functions  of  ye(*)  such  that 

supt  £E  |  f £  (t)  |  <  «>  ,  and  E  |  f e  (t)  |  -*■  0  as  e  -►  0,  each  t.  Then  we 

* 

say  that  p-lim£^pf  =0.  We  also  say  p-lim^gf  (•)  *  0  if  for  each 
6  >  0,  f  (•)  is  a  (progressively  measurable)  function  of  y£(*)  and 
0£('),  and  supt^  6e|  f 5  (t)  |  <  ®  and  E  |  f 6  (t)  |  ■+•  0  as  6  +  0 .  We  say 
that  fe  e  ^(a£)  and  A£f£  =  q£  if 

E£fe(t+<S)-f£(t) 

p-lim  [ -  -  q£(t)]  *  0 

<5^-0  6 

£ 

and  g  (•)  is  p-right  continuous.  See  [1]  for  more  detail. 

^1  3 

Let  bg  ^ '  denote  the  space  of  real-valued  functions  on 
R  x  t0,»)  with  compact  support  and  whose  first  three  x-derivatives 
and  first  t-derivative  are  continuous.  By  Theorem  1  of  [1] ,  in 
order  to  prove  the  proposition,  we  need  to  prove  tightness  of 
(0e(-)  ,e-0,a-M»  and  for  each  f  ( - )  G  SfJ'3,  we  need  find  a  sequence 
fe(*)  €  0(A£)  such  that 

p-lim  If G ( - )  -  f (@£(«) ,•)]  =  0 
e-*b 
a-*-0 

(A5) 

p-lim  [Aef e ( • )  -  (|r  +  A) f ( @£ ( • ) , • ) ]  =  0, 
e+0 
a-+0 
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r 


where  A  is  the  infinitesimal  operator  of  the  diffusion  (A4) . 
in  [1] ,  we  will  get  f e  ( - )  in  the  form  fe(*)  =  f(0e(*),*)  +  f^(t)  + 
f£(t),  where  the  f|  will  be  defined  below.  First  the  fe(*)  will 
be  found,  then  tightness  discussed.  Even  without  tightness  (A5) 
implies  that  the  finite-dimensional  distributions  of  (A3)  converge 
to  those  of  (A4)  [1,  Theorem  1] . 

Step  1.  By  the  stationarity  and  distributional  properties 
of  y ( • )  and  uniformity  in  s  in  bounded  sets ,  we  have 


^  E  ga  (s+ye  (t) /e)  =  ~-[P{y  (0)  >-es+ea}-P{y  (0)  <-es-ea}  ]  +  0(ea)/e 

=  \/|  •  |  +  0(a)  +  0(e). 

From  this  we  can  see  the  necessity  of  the  Le  ■  L/e  scaling . 

Step  2 .  Fix  f  ( •  ,  • )  €E  Then  (subscripts  x,  t  on  f(*,*) 

denote  the  derivatives  with  respect  to  the  first  and  second  argu- 
ments ,  resp . ) 

(A6)  Aef(8e(t),t)  =  ft(9e(t),t)  +  fx(eE(t)  ,t)ga(s(t.e£(t)>tye(t)/e)/- 

Continuing  to  follow  the  method  of  [1],  f£(*)  is  to  introduced 
in  a  way  that  allows  "cancellation  or  averaging  out"  of  the  l/e 
term  in  (A6)  . 

Define  the  centered  function  (the  expectation  is  over  y(0) 
only,  0e  is  considered  to  be  a  parameter  here)  9a ( * )  by 

ga(ee,t,y£(t)/e)  =  ga(s(t,6e)+ye(t)/e)-Ega(s(t,ee)+y(0)/e) . 


i 
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Now,  define  f ^ ( - )  by  f[(t)  =  f^(6l(t),t)  where 

CO 

fj(6.t)  =  |  |E^fx(e,t+T)ga(0,t+T,ye(t+T)/e)dT 
0 

00 

=  e  |E^fx(6,t+e2T)ga(0,t+e2T ,y (^2  +x)/e)dx. 
0 


Note  that  p-limc^0  f^(*)  =  0,  owing  to  the  centering  about  the 
mean,  and  the  exponential  correlation  of  the  Gaussian  process 
y(*).  In  fact,  it  will  be  shown  that  it  follows  from  the  estimate 
(A7)  . 

(A7)  on  the  set  {|y(0)|<l}  or  even  on  {|y(0)|<e  }. 

-a,T 

|p{y(T)  (r.  B  |  y  ( 0 )  }  -  P{y  (t)  C-.  B}  I  <  Ce  for  some 

a^  >  0,  uniformly  in  B.  The  0  and  x  arguments  of 
y(.)  can  be  replaced  by  t  and  x+t,  resp.  Similarly , 

for  T2  >  xx  >0,  |p(y(xi)CBi,  i=l,2|y(0)>-  P(y.(xi)€Bi, 
i=l , 2 } |  <  Ce  for  some  a^  >  0. 

In  the  sequel  the  values  of  the  constants  a^  >  0  and  C  may 
change  from  usage  to  usage . 

To  show  (A7) ,  we  note  that  (y(t),y(0))  are  Gaussian  with  mean 
zero  and  correlation  exp  -at,  and  compare  the  two  distributions, 
the  first  of  y(x)  (or  y(T1),y(T2))  with  initial  condition  y(0), 
and  the  second  the  stationary  distribution  of  y(T)  (or  of  y  (  T^)  »y  (  t2) ) 
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Estimate  (A7)  implies  that  |f^(t)|  =  0(e)  uniformly  in  u  on 
{  |ye  (t)|<l>  (the  integrand  of  the  second  expression  defining  f ![  ( • ) 
goes  to  zero  exponentially  on  that,  set  by  (A7) )  .  Define  \r1  = 
min{r :  e~aT/2 | ye (t) | <1} .  Write 

V1 

f^(0,t)  =  e  |  E^Bdx  +  e  J  E^Bdx, 

0  V1 

where  B  is  the  argument  of  E^  in  the  second  expression  above  for 
£  A 

f^(0/t).  The  first  term  is  bounded  in  absolute  value  by  eCv^  and 
the  integrand  of  the  second  by  C  exp  -a^x-Vj.),  which  is  inte- 
grable .  Thus 

(A8)  J  f J (t) |  <  Ce[l+Vl] 

<  Cell  +  max ( 0 ,  log|ye(t) |) ] , 

justifies  the  p—lim  assertion  above.  To  see  hov?  a  mixing 
condition  such  as  (A7)  can  be  used  to  get  bounds  on  functions 
such  as  EfcF(y(t+x))  for  bounded  measurable  F(*)  satisfying  EF(y(t)) 
=  0,  in  more  general  cases,  see  [9,  Lemma  1], 

Step  3.  it  can  be  verified  that  (for  some  version,  as  always) 

f!?(»)  G  ^(Ae)  and  that 
J-  \ 
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(A9)  AEf^(t)  =  -  |  fx(6e(t) ,t)5a(0e(t) ,t,ye(t)/e) 

CO 

+  ~  [dr  E^[fx{0£(t) ,t+T)5a(9e(t) ,t+T,ye(t+T)/e)]x 
0 

•  ga(s(t,ee(t))+ye<t)/e)/e. 

The  first  term  of  Aef^(t)  =  Aef ^ (0E (t) , t)  is  (loosely)  the  coni'- 

ponent  of  the  derivative  with  respect  to  t,  when  0e(O  is  held 

constant,  and  the  second  term  contains  the  contributions  to  the 

derivative  due  to  the  0E(«)  variations  only.  The  (non-mean) 

part  of  the  first  term  on  the  right  cancels  the  second  term  of 

(A6) .  This  is  why  f^(*)  was  defined  as  it  was. 

The  second  term  of  (A9)  has  two  components  which,  after  a 

2  - 

change  of  variable  x/e  x,  can  be  written  as  (g  denotes  the 

01  f  X 

derivative  of  ga ( • ) ) 

00 

(A10)  jdx  E£fxx(0e(t)  ,t+e2x)ga(0e(t)  ,t+e2x,y(^-  +x)/e) 

0  e 

•  ga(s(t,0E(t))+y(t/e2)/e)  + 

00 

+  jdx  EEfx(§E(t)  ,t+e2x)ga^x(0E(t)  ,t+e2x,y(^-  +  x)/e) 

0  *  E 

•  g^ (s (t , 0E ( t) ) +y (t/c2) /e) . 
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Step  4.  Both  terms  in  (A10)  exist  by  the  same  arguments  which 
lead  to  (a8)  .  We  wish  to  show  that  the  second  term  of  (AlO)  is  neg 
ligible,  as  well  as  get  an  estimate  which  is  useful  for  the  tight¬ 
ness  argument.  The  fact  that  the  support  of  gaX(«)  is  in  t-a,al 
and  that  |g  (x) |  <  C/a  and  the  uniform  boundedness  of  s(t,9e(t)) 
will  be  used  heavily.  Let  1(a)  denote  the  indicator  function  of 
the  set  A, 

By  the  use  of  <A7) ,  it  can  be  verified  that  (the  bounds 
below  are  uniform  in  s  in  bounded  sets) 


(All)  |E^ga  x(s+y(~  +  T)/e)|  <_  [exp  -a.T  +  it  |  yE  (t)|>eax/2 }]  C/a . 

*  e  x 

We  need  a  bound  which  goes  to  zero  as  e  -*•  0.  Proceeding  to  get 
this,  we  have 

(A12)  F{  |  s+y  (—  +  t)/c|  <  a|yE(t)=y0}  =  O(ae) 

uniformly  in  |yQ|  >  1  and  x  >  0. 

The  estimate  (A12)  and  the  fact  that  the  support  of  g  (•)  is 

a,x 

in  [-a, a]  and  that  it's  bounded  by  C/a  yield  that  the  left  side 
of  (All)  is  also  bounded  above  by  0(e),  uniformly  in  |ye(t)|  >  1, 

T  —  0.  This  *  and  (All)  yield  that  on  the  set  |ye(t)|  >  1  the  left 
side  of  (All)  is  bounded  above  by 

(A13)  (exp  -alT  +  I{|y£(t) \>ear/2}]1^2  C(e/a)1/2. 

Note  that  |x|  <  a,  |x|  <  b  imply  |x|  <  /iH. 
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Integrating  (A13)  with  respect  to  t  in  [0,®)  and  noting  the  bound¬ 
edness  of  gQ  and  f  yields  the  upper  bound 

C [1  +  max(0,  log|ye(t)|)]  (e/a)1//2 

on  the  second  term  of  (A10)  when  |ye(t)  |  1. 

In  order  to  get  a  suitable  bound  for  the  case  |ye(t) |  <  1, 
split  the  integral  of  the  second  term  in  (AlO)  as 

e  °° 

M- 

0  e 
e 

The  /  is  clearly  0(e/a).  For  the  other  term  note  that  for  t  >  e, 

0  _  t  2~ 
the  density  of  yf-^r  +  e)  /  conditioned  on  any  value  of  |y(t/e  )  | 

in  [0,1],  is  <  0(l//e).  Thus  (A12)  holds  in  this  case  (t  >_  e, 
|y(t/e  ) |  <  1),  but  with  O(oe)  replaced  by  0(a/e) .  Again,  combin¬ 
ing  these  estimates  with  (All)  yields  that  the  left  side  of  (All) 
is  bounded  above  by  (A13)  also  when  (|y  (t/e  )|  <_  1)  ,  but  with 
(E/a)^2  replaced  by  e^^/a^2.  Integrating  the  bound  with  res¬ 
pect  to  t  in  [0,®)  yields  the  upper  bound  to  the  second  term  of 
(AlO)  : 


(A14)  C [1  +  max { 0 ,  log|ye(t) | ) ] e1/4/a1/2. 

Clearly  p-lim£^Q  ^(second  term. of  (AlO))  =  0. 
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Step  5.  Turning  our  attention  to  the  first  term  of  (A10) ,  it 
will  be  "averaged  out"  by  use  of  a  f \ ( ■ ) .  This  "averaging  out" 
will  give  use  the  second-order  term  of  the  operator  of  the  limit 
process.  Define  Agf(0,t)  to  be  the  expectation  of  the  first  term 
of  (A10)  when  0e(t)  is  replaced  by  the  parameter  6.  Using  the 
stationarity  of  y(*)»  we  have 


Aof  (® 


,t)  =  | E  fxx(0,t+e2T)ga(0>t+e2T,y(T)/e)ga(s(t,e)+y(O)/e)dT 


=  ^2  |  E  fxx(0/t+T)ga(9,t-HT  ■■■|+T*-)ga(s(t,e)+y  (~)/e)dx. 
e  0  e 


Define  f| (t)  =  f2(0e(t),t)  by 


uu  uu 

(A15)  f^ ( 0  # t)  =  dv  {[d't  [fxx  ( § ,  t+a+v)  gct  (6  ,t+T+v  ,y  /e) 

J  J  p  c 


0  0 

00 

ga(s(t+v,0)+y(^y^)/e)  ]  -  Agf  (0  ,  t+v)  }  .  =  J 
e  e  q 


=  |  dv  F£ (t+v) . 


Note  that  when  v  =  0  the  inner  {}  term  (F£(t)}  is  just  the  first  term 

of  (A10)  (with  a  change  of  variable)  minus  its  exponentiation  and  with 

2  2 

0e(t)  replaced  by  8.  By  a  change  of  variables  x/e  -*■  x,  v/e  v,  and 
an  application  of  (A7)  similar  to  that  used  to  get  the  bound  on  |  f ^  (t)  |  , 
we  get  that  the  inner  integral  F£ (t+v)  exists  for  each  v.  We  will 
soon  show  that  the  double  integral  exists.  Define 


H£(0,t,x,v)  =  fxx(§, t+e2x+e2v) 


gQ(0,  t+e2x+e2v,y  (^+x+v)/e)go(s(t+e2v,§)  ,y(^+v)/e)  . 
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An  alternative  representation  (using  the  above-mentioned  change  of 
variables)  of  f^^t)  is 

00  oo 

(A16)  e2  |  dv  |  dt[E^He(0,t,T,v)  -  EH£ (6 , t , T ,v) ] . 

0  0 

Denote  the  integrand  by  E^B.  The  inner  integral  still  exists,  of 
course  -  we  oiily  changed  variables.  Recall  v^  = 
mintv:  e  aV//2  1  y  ( t/e2)  j  <1)  .  Write  the  last  integral  as 


f  dv  } 


dr 


EtB 


+  e 


dv 


dx 


EtB 


=  II  +  I, 


Let  us  now  evaluate  II.  By  (A7)  and  the  definition  of  v^, 
the  absolute  value  of  the  integral  in  II  is  bounded  above  by  some 
C  exp  -a^fv-v.^),  a1  >  0.  Also,  |E  H£(0,t,x,v)|  <  C  exp  -a-^x 
for  some  a^  >  0.  Furthermore,  by  (A7)  and  v  •>  v^,  and  for  some 
C  >  0,  a^  >  0  (whose  values  may  again  change  from  usage  to  usage) 


lEt  H  (0,t,x,v) |  <  e£|ee  ,  H  (6,t,x,v)| 

t+e~v 

<  C  E^[exp  -a^x  +  l(e  aT^2|y(^j+v)  |>1)] 

e 

=  C  exp  -a^x  +  C  P{  |y(^+v)  |  >^eaT//2  |v>v1#y  (u)  ,u<t/e2} 

e 

£  C  exp  -a^x  +  C  e-aT//2  E{ |y (^y+v) | | v>v^,y (u) ,u*t/e2} 


£  C  exp  -a^x. 


By  combining  the  above  estimates,  we  get  that  the  integral  in  II 


is  bounded  in  absolute  value  by  C  exp  -a^v-v^t)  and,  consequently, 
II  =  0(e2) . 

2  ~ 

The  component  I  is  also  0(e  )  but  not  uniformly  in  ye (t) . 

Bound  the  inner  integral  of  I  by 


oo  oo 


By  the  arguments  connected  with  the  bound  on  |fE(t) |,  we  get  the 
bound 


III  <  Ce2Ee[1  +  max(0,  log  |  y  (^+v)  | )  ]  . 
Using  the  concavity  of  max(0,  logjy|), 

III  £  Ce2  [1  +  max (0,  log |ye (t) | ) ] . 

Since  v1  <  C  max(0,  log|ye(t) |),  we  have  that 
(A17)  | f 2 (t)  |  £  Ce2  [1  +  max (0,log |ye (t)  | ] 2 . 


£  £ 

Furthermore,  it  can  be  shown  that  f2(*)  £  3>  (A  )  and  that 
Aef2 (6e (t) , t)  =  AEf 2 (t)  equals  the  term  obtained  by  holding  0e(*) 
constant  plus  the  term  obtained  by  holding  t  constant  (in  the 
calculation  of  the  "derivative"  of  f 2  (0e  (•),•)  .  In  particular, 


c  ^  c 

Aef2 (t)  =  [negative  of  first  term  of  (A10)  +  AQf(e  (t),t)] 


+  (term  whose  p-lim  equal  zero) . 
e-*0 
a+0 


The  first  term  is,  of  course,  just  -F£(t).  The  latter  (p-lim  =  0) 
term  is  f~  (6 , t) g  (s (t , 0 ) , t ,ye ( t) /e) /e  =  f£  (§,t)§,  where  0  = 

Z  f  X  ct  z  ^  X 

0e(t)  and  the  f^  is  the  derivative  with  respect  to  the  6  argu- 
ment.  It  can  be  shown  that  this  derivative  can  be  taken  under 
the  integral  sign  in  (A15) .  The  components  of  the  derivative  which 
involve  fxxx  are  uniformly  bounded  by  0(e).  The  other  components 
are  of  the  form 


^Et^xxga,xga  +  Et^xxgaga,x  Efxxga,xga  E^xxgagct ,x^Tdv  ga 


with  the  obvious  arguments  for  the  functions,  it  is  treated  similar¬ 
ly  to  the  way  (A16)  was  treated  and  is  bounded  by  (A17)  but  with 


e/a  replacing  e  . 


Step  6.  By  combining  the  above  estimates  with  f£ 
(9/9x  denotes  9/30,  as  usual). 


f  +  fl  +  f2 


p-lim [r  (t)  -  f(0e(t),t)J  =  0 


p-lim[Aefe(t)  "  (ft  +  (/§  |_  +  A£)f  (9e(t)  ,t)j  = 


A  very  similar  proof  to  that  of  [1,  Section  6,  part  2]  yields 
that  A_f(0,t)  ->  fxx(6»t)  In  2/a  uniformly  in  0  for  each  t.  Then, 
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by  [1,  Theorem  1]  (see  the  part  of  Appendix  2  above  step  1) ,  the 
finite-dimensional  distributions  of  (0  (•))  converge  to  those  of 

A 

the  Markov  process  0 ( - )  with  infinitesimal  operator 

2  s (t , 9  (t)  )  3  +  In  2  3^  . 

it  o  3x  a 

i.e.,  to  (A4) .  This  convergence  of  finite-dimensional  distribu¬ 
tions  is  good  enough  for  many  applications. 

Step  7.  Tightness.  We  skimp  on  details.  Either  [ll ,  Lemma  1] 
or  [10,  Theorem  2]  can  be  used.  The  boundedness  required  in  [10, 
Theorem  2],  can  be  dropped  here,  since  finite-dimensional  distribu¬ 
tions  converge  (for  justification,  see  the  remarks  on  p.  623  of 
[12]).  The  estimates  that  we  need  for  the  use  of  either  of  these 
theorems  are  supplied  by  (A14) ,  (A17) :  namely,  we  need  that  for 
each  T  >  0 

lim  lim  P(sup|  Aef e  (t)  |  _>  N> 

N-*00  e-*-0  t<T 
a-*-0 

lim  P  su.p{ f  5  ( t) +f  5  ( t)  |  ><5>0) 
e+0  t<T 

all  of  which  can  be  proved  from  (A14) ,  (A17) ,  since  for  any  con¬ 
stant  y  >  0,  the  Gaussianness  and  stationarity  imply  that 
iim^O  suPt<T  eY  I y  <t/e2)  |  =  0  w.  p.  1. 


=  0, 

=  0 ,  each  6  >  0  , 
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Appendix  3 

Getting  from  (A4)  to  (3.3)  and  then  to  (3.5)  is  much  easier 

than  getting  (A4)  ,  since  we  are  working  with  ltd  equations. 

Over  any  finite  interval  [0,T] ,  the  measures  in  C[0,T]  induced 

by  (A3)  are  absolutely  continuous  with  respect  to  Wiener  measure, 

uniformly  in  and  [8]  .  Thus  the  sequence  given  by  (A4)  and 

2 

parametrized  by  is  tight  in  C[0,°°).  Since  the  measure  of  any 
limit  process  must  also  be  absolutely  continuous  with  respect  to 
Wiener  measure,  it  can  be  shown  that  any  limit  must  have  the 

form  (3.3)  even  though  the  drift  is  discontinuous.  A  "Skorokhod 
imbedding"  technique  can  be  used  to  fill  in  the  details;  i.e.,  we 
can  choose  a  weakly  convergent  subsequence  with  limit  denoted  by 
§(•)  and  we  choose  the  probability  space  so  that  0(*;Oq)  -*■  §(•) 
uniformly  as  -*■  0  on  each  interval  [0,T],  w.  p.  1.  The  form  of 
the  limit  of  the  chosen  convergent  subsequence  can  easily  be 
seen  to  be  (3.3)  by  this  operation.  There  can  only  be  one  limit 
to  the  original  sequence,  since  all  limits  have  the  form  (3.3) 
and  the  solution  to  (3.3)  is  unique  in  the  sense  of  measure. 

Now,  we  go  from  (3.3)  to  (3.5)  as  u>q  -*•  <*>.  Again,  Theorem  1 
of  (1]  is  used.  As  noted  in  the  previous  paragraph,  the  solutions 
of  (3.3)  (parametrized  by  u)Q)  are  tight  in  C[0,°»).  Write  u)Q  =  p 
and  denote  the  corresponding  solution  to  (3.3)  by  §^.  Then,  for 
each  f(*,*)  €  ,  we  need  only  find  a  sequence  f ^  ( • )  G  20  (A^*) 

for  which  (A5)  (e,  a  replaced  by  p)  holds.  Define  (subscripts 
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t,  x  denote  the  appropriate  derivatives  with  respect  to  the 
second  and  first  argument  of  resp.) 

2tt/p 

fP(t)  =  2tT  J  Et  f(6P(t+s) /t)dsf 


0 


where  Ep  denotes  conditioning  on  9p(u),  u  ^  t.  Then  fp(")  E  ^(Ap) 
and 

2tt/p 

Apfp(t)  =  J  Epft(0p(t+s)  ,t)ds 
0 

EPf  (0P(t+27i/p)  ,t)-f  (0P(t)  ,t) 

+  271 7p 


=  Sp(t)  +  SP(t). 


Because  of  the  bounc’.edness  of  the  drift  coefficient  in  (3.3) 
and  the  absolute  continuity  with  respect  to  Wiener  measure , 

(A18)  E|  0p(t+s)-9p(t)  |  -*■  0  as  s  -*•  t,  uniformly  in  t,  p. 

Thus 

p-lim 

p-lim 

p->°o 


[fP(t)-f (0p(t) ,t)J  =  0, 

fsp (t) -f t ( 0  P ( t) ,t)]  =  0. 
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We  need  only  evaluate  the  limit  of  s|(-).  By  applying  It6's 
lemma  to  Sp  ( • )  and  the  process  (3.3), 


S2(t) 


2it/p 


D  f  ^7T/p 

t?J  EZfxx<°P(t+s)'t)  iB-ids  +  ^  J  EtPfx(eP(t+s),t) 

.  {Jl  sin  S  <t+S)  +  SP(t+S) )  sign  [cos  (t+s) +9P (t+s)  )1 


]  ds 


—  mP 


T^(t)  +  TP(t) 


Also,  p-limp^  [TP(t)-fxx(eP(t),t)  =  0. 

We  need  only  check  that  T? ( • )  has  the  correct  (p-lim  sense) 

Z  p->-oo 

limit.  Using  the  Fourier  series  introduced  in  Section  3.1,  write 
T?/  (x^-  in  the '  form 

Z  YU  O 


2u/p 

2iTEt  j  fx<ep(t+s),t)|  sin(e(t+s)-ep(t+s))ds 
0 

2n/p 

+  2if  Et  J  ds  fx(0P(t+s)  rt)|lsin(2p(t+s)+e(t+s)+eP(t+s) ) 

0 

+  2  sin<p(t+s,+8<tts>>J1  T5ETIT  oos(2k+l)  (p(t+s)+ep(t+s))] 

2j/p 

+  Sr  Et  J  ds  fx<®P*t+s) ft) J[sin(p(t+s)  +  0(t+s) )  • 

0 

CO 

*  jcA+lT2k+l)  cos(2k+l)  (p(t+s)  +  ep(t+s))] 


=  xl(t)  +  Ip(t)  +  Ip(t). 
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As  earlier, 

p-lim  [Ip(t)-f  ( ep ( t) ,t)  \  sin(6(t)-0p(t)) ]  =  0. 

p->-°° 

By  (A18.)  ,  we  can  replace  8p(t+s)  by  0p(t)  in  Ip(t)  without  altering 
the  p-lim.  By  doing  this,  we  see  that  p-lim^^  Ip(t)  =  0  for 
each  N:. 

For  each  Tg  >  0,  Tg.  <  T  <  °°,  there  is  a  finite  measure  which 
(uniformly  in  p  anc  t  e  [TQ,T])  dominates  the  measure  of  0p(t).  __ 

Using  this  and  the  fact  that  (the  mean  square  value  of  the  tail 
of  the  Fourier  series  of  sign [cos (p (t+s) +y]  5  q(s)  over 
[t,t+p/2-rr])  _ 


E_ 

2n 


2tt/p 


I  l 

k=N+l 


(-1) 

(2k+l) 


cos(2k+l)  (p(t+s)+y)  |  qs  0 


uniformly  in  t,  y  and  p,  as  N  +  yields  that  E|l^(t) |  can  be 

made  as  small  as  desired  by  making  N  large.  This  and  p-lim  1^  = 

0,  each  N,  yields  p-lim (Ip  +  lp]  =  0. 

Next,  choose  a  weakly  convergent  subsequence  of  the  process 
(8p(t) ,  t>TQ>0}.  Then  6p(Tg)  converges  weakly  to  a  random  var¬ 
iable  §(Tq).  As  Tq  -*•  0,  the  uniform  absolute  continuity  with 
respect  to  Wiener  measure  on  bounded  time  intervals  implies 
that  §{Tq)  must  converge  to  0 p ( 0 )  =  @(0)  weakly  as  Tg  -►  0.  This 
and  the  uniqueness  of  the  solution  to  (3.5)  imply  that  {8P(*)} 
converges  weakly  to  (3.5) . 

L 
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